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ABSTRACT 

At  first,  this  paper  introduces  the  structure  of  the  depth-image  capturing  system  using  the  single-stripe  pattern. . At  second,  its 
operating  principle  is  introduced,  its  mathematical  model  is  established  and  the  calibrating  method  for  it  is  put  forward.  At 
last,  its  prototype  is  produced  and  calibrated. 
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1.  INTRODUCTION 

It  is  not  unique  to  recover  the  3D  shape  of  objects  from  their  usual  intensity  images  because  information  of  depth  is  lost.  But 
the  depth-images  have  3D  information  of  object  surfaces,  so  they  are  used  not  only  to  measure  3D  shape  of  object  surfaces 
but  also  to  provide  a new  approach  to  pattern  recognition. 

This  paper  puts  forward  a kind  of  depth-image  capturing  system  based  on  structured-light.  As  known,  its  distortion  can  be 
transformed  into  the  height  change  in  the  direction  of  the  stripe  if  a single-stripe  light  is  emitted  and  observed  sideways.  So  a 
generator  emitting  a single-stripe  light  and  a camera  can  make  up  of  a depth-image  capturing  system.  It  can  obtain  the  depth- 
image  of  the  detected  object  section.  If  the  object  is  shafted  by  definite  step  along  a fixed  beeline  direction!*),  the  depth- 
image  of  full  object  surface  is  achieved  when  the  system  repeats  the  above  said  operation1. 


2.  THE  BUILDUP  OF  OUR  SYSTEM 

The  buildup  of  the  depth-image  capturing  system  based  on  structured-light  this  paper  is  shown  in  Fig.l.  It  includes 
semiconductor  laser  and  its  optical  system,  CCD  camera,  image  collecting  card,  computer  and  its  software. 


3.  MATHEMATICAL  OF  OUR  SYSTEM 

The  operating  principle  of  our  system  is  shown  in  Fig.2.  The  center  of  the  camera  len  is  the  point(M).  The  light  emitted  from 
the  laser  is  becomes  a sector  plane  light  through  the  optical  system,  which  is  vertical  to  the  pIane(xor).  Its  vertex  is  is  located 
at  the  origin(o)  of  the  world  coordinate  system(xyzo),  and  oM=B.  The  plane  light  forms  a strip  on  the  measured  object.  Any 
object  point  P(a\  y,  z ) on  the  strip  produces  its  image  point  P0(x,  y)  on  the  image  planefcoOoio)  in  the  camera  coordinate 
system(A'aVor0Oo).  The  plane(xO0oZo)  coincides  with  the  plane(*oi).  The  ray(oP)  is  at  an  angle  of  (f>  to  the  plane(*oz),  its 
projection  on  the  plane(*or)  is  at  an  angle  of  a to  the  axis(ox).  In  this  paper,  a is  made  to  equal  90°.  The  optical  axis(ooXo)  of 
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the  camera  is  at  an  angle  of  /?0  to  Mo.  The  focus  of  the  camera  is  equal  to  o0M.  The  ray(MP)  is  at  an  angle  of  y to  the 
plane(xor),  the  projection  of  y onto  the  plane(yO0oZo)  is  6.  The  projections  of  the  ray(MP)  onto  the  plane(xo?)  is  at  an  angle  of 
p to  Mo.  The  visual  angle  of  the  camera  is  2px.  The  pixel  sequence  numbers  of  camera  along  the  horizontal  directi  on  (x0)  and 
the  vertical  direction(yo)  are  respectively  n and  m,  where  n is  from  -Arto  A^and  m from  ~~M to  M. 


According  to  Fig.2,  we  have  from  the  camera  geometry*" 


ctga  + 


: = z * ctga  = 0 


V N )_ 

x { )n 


sin/?0  -cos/?0f^Aj« 


ctgp  0 +{t^\n 
V N J 


where  n and  m are  obtained  from  the  image;  the  parameters  of  p0,  P\,  B are  constants  to  be  calibrated. 

4.  METHOD  OF  OUR  SYSTEM  CALIBRATING 

4.1.  Calibrating  Model  of  Our  System 

Ai  z 

The  calibrating  principle  of  our  system  is  shown  in  Fig. 3.  Fig.3  is 
the  projection  of  Fig.  1 (Fig.2)  on  the  plane  of  xoz.  In  Fig.3,  The  x. 

reference  plane  is  parallel  to  the  plane  of  xoy  and  the  distance 

between  them  is  equal  to  A;  the  distances  from  object  points  of  Zx,  Z2  /?,  F 

Z2  and  Z3  to  the  reference  plane  are  zh  z2  and  z3,  their  image  points  N\  / 

are  separately  on  the  right  side  column,  the  middle  column  and  the  Zx  / 

left  side  column  of  the  camera  image  plane.  a 

According  to  the  geometrical  relation  in  Fig.3,  we  have  A 

zx  + A - B ■ tan( /?0  - /?, ) (4)  0 M 

z2  + A = B * tan  pQ  ( 5 ) 

~3  + A ~ B • tan(/?0  A ) ^ ^ Fig.3  Projection  of  our  system  on  the  plane  of  xoz 

From  formula  (4),  (5)  and  (6),  the  following  formula  is  deduced. 


Reference  plane 


(z,  +2,  +2 A)(z1+ A)2  -2(Zj  + A)(z2  +A)(z/+  A) 


It  is  clear  that  B can  be  obtained  if  a reading  of  A is  given.  Formula  (7)  is  the  calibrating  model  of  B. 

From  formula  (4),  (5)  and  (6),  the  following  formulas  are  deduced  again. 

r«,  + A 

pn  = arctan  — 

™ B ■ 

~ + A 

P\  =-  arctan  + 


Z~  ~r  A 

P . = arctan  — 

Hx  B 
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Formula  (8)  and  (9)  or  (10)  is  the  calibrating  model  of  and  x. 
From  formula  (3),  we  have 


y = T7’t m A (5-  cos/?0  + ~$in/?0) 

M 

When  column  number  of  n is  changeless,  we  have 

cot B W|  ZUh  ^■cos^o+^-sin^Q  (11) 

y,-y2  m 


It  is  dear  that  jB>  can  be  obtained  if  readings  of  (/n1-m2)  and  (y\-y2)  are  given.  Formula  (1 1)  is  the  calibrating  model  of  /£. 


4.2.  Calibrating  Process  of  Our  System 

The  calibrating  equipment  includes  a guide  with  a scale,  placed  along  the  lines  of  oz,  and  a standard  plane  parallel  to  the 
reference  plane,  placed  on  the  moving  part  of  the  guide.  At  firat,  zh  z2  and  z3  are  calibrated  across  experiment.  And  then.  B . 
/?o,  P\  and  A are  calibrated.  At  last,  fii  is  calibrated.  The  concrete  process  is  as  the  following: 

1)  The  standard  plane  is  shifted  until  the  single-stripe  image  appears  on  the  right  slide  column  of  image  plane.  Here  the 
standard  depth  Z\  is  1 1 1mm  according  to  the  scale  of  the  guide. 

2)  The  standard  plane  is  shifted  until  the  sifigl e-stripe  image  appears  on  the  middle  slide  column  of  image  plane.  Here  the 
standard  depth  z2  is  320mm  according  to  the  scale  of  the  guide. 

3)  The  standard  plane  is  shifted  until  the  single-stripe  image  appears  on  the  left  slide  column  of  image  plane.  Here  the 
standard  depth  z3  is  9 1 0mm  according  to  the  scale  of  the  guide. 

4)  The  designed  value  ofy4(/4=95mm),  zh  z2  and  r3  are  substituted  into  formula  (7),  (8),  (9)  or  (10).  Then  the  values  of  B. 
and  P\  are  calculated. 

5)  The  standard  plane  is  shifted  until  the  single-stripe  image  appears  on  some  column  of  image  plane.  Here  the  standard 
depth  Zi  is  obtained  from  the  scale  of  the  guide  and  the  reading  of  n,  is  given  by  the  camera  image  plane. 

6)  Many  groups  of  (z„  n j)  are  obtained  when  repeating  process  5). 

7)  According  to  n„  the  depth  calculated  value  of z\  is  obtained  from  formula  (1). 

I 2 

8)  Calculate  least  square  error  of 

i=l 

9)  Correct  the  value  of  A to  make  the  least  square  error  reduce. 

10)  Repeat  process4)~9)  until  the  least  square  error  becomes  least.  Here  the  value  of  A is  best  and  used  as  calibrated  value. 


The  calibration  result  is  as  the  following:  5=31 1.916mm,  /?0=52.7372°,  /?1=19.9293°,  yf=90mm. 


Row  numbers  of  two  images  of  the  same  column  of  m{  and  m2  can  directly  be  obtained  from  the  image.  Then  the  value  of 
can  be  calibrated  according  to  formula  (11),  if  the  height  difference  of  (yi-y2)  is  known,  where  the  object  point  height 
corresponding  to  image  point  row  number  mx  is  expressed  as  yx  and  m2  expressed  as  y2.  The  concrete  process  is  as  the 
following: 


1)  The  standard  measuring  block  is  placed  in  the  view  field  of  the 
system,  perpendicular  to  the  plane  of  xoz  and  parallel  to  the 
reference  plane,  shown  as  in  Fig.4. 

2)  The  upper  surface  height  of  the  standard  measuring  block  is 
expressed  as  yu  the  lower  surface  height  expressed  as  y2.  Then  the 
standard  value  of  the  measuring  block(  100mm)  is  used  as  the 
height  difference  iy\~y2)  in  formula  (11). 

3)  The  intensity  image  of  the  block  is  shown  in  Fig.5.  The  row 
numbers  of  m{  and  m2  are  made  sure  by  image  processing.  The 
tow-valued  fringe  image  of  the  block  is  shown  in  Fig.6.  From  its 
grey  data,  m{  and  m2  can  directly  be  obtained 

4)  The  calibrated  value  of  can  be  calculated  when  substituting 
( y\~yi, ) and  (mx-m?)  into  formula  (11). 

The  calibration  result  is  that  ^=15.0703°. 


Standard  measuring  block 


Fig.4  Placement  of  the  standard  measuring  block 
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5.  EXPERIMENT  RESULTS 


As  shown  in  Fig.7,  the  bright  stripe  is  the  section 
outline  of  a plaster  head  portrait  figure,  and  its 
depth  image  is  shown  in  Fig. 8. 

The  depth  image  experiment  of  a water  heater 
mode]  is  shown  in  Fig. 9.  The  stripe  image  of  the 
model  is  as  shown  in  a,  and  the  depth  image  of  the 
model  is  as  shown  in  b. 


Fig.5  Grey  image  of  bloc)  Fig.6  Two-valued  fringe  image  of  block 


Fig.7  Stripe  image  of  the  plaster  head  portrait 


Fig.  8 Depth  image  of  section  of  the  plaster  head  portrait 


a.  Stripe  image  of  the  water  header  model 


b.  Depth  image  of  the  water  header  model 


Fig.9  Depth  image  experiment  result  of  the  water  header  model 


6.  CONCLUSION 

This  paper  introduces  the  depth  image  capturing  system  based  on  structured-light  and  proposes  the  calibration  method  for 
our  system.  The  experiment  results  show  that  our  system  prototype  has  the  measuring  scale  of  300mm(y)x300mm(z),  the 
resolving  power  of  0.5mjrn(y)x0.5mm(z)  and  the  precision  of  1.5mm(y)xl.5mm(z). 
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